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1 .  General 

A  program  is  available  now  to  determine  the  monthly-mean  error 
patterns  at  sea  level  and  500  MB  for  the  24-hour  and  48  hour  forecasts. 
In  addition,  comparative  RMSE  scores  are  produced  for  each  forecast 
(out  to  72  hours) , 

Table  1  contains  the  results  for  the  month  of  November  1970. 
Note  that  points  south  of  20°  North  are  omitted  because  they  tend  to 
mask  the  actual  performance  in  the  latitudes  where  significant  changes 
are  taking  place.  In  general,  the  PE  Model  did  exceptionally  well, 
when  compared  to  either  the  SLP  or  persistence.  Although  the  SLP  was 
often  worse  then  persistence  by  36-48  hours  during  November,  it  is 
noteworthy  that  every  PE  forecast  contained  skill  through  72  hours. 
Figure  1  graphically  illustrates  the  comparative  results. 

2  .  Mean  Error  Study 

Figures  3  and  4  represent  the  mean  error  patterns  in  the  month  of 
November  for  the  24-hour  and  48-hour  PE  sea-level  pressure  forecasts, 
respectively. 
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To  interpret  these  results,  some  of  the  pressure  distributions/ 
evolutions  should  be  described.  During  this  period,  Asia  and  North 
America  were  dominated  by  cold  highs.  The  Asian  high  was  especially 
strong,  with  central  values  above  1050  millibars  on  occasions.  Over 
the  United  States,  the  highs  were  progressive,  with  occasional  inter¬ 
ruptions  by  progressive  lows  crossing  the  northern  tier  of  states.  The 
N.  Pacific  was  a  very  active  cyclonic  region.  The  N.  Atlantic  was 
also  active,  but  less  so  than  in  the  Pacific. 

Referring  once  again  to  Figures  3  and  4,  it  is  noted  that  the  main 
systematic  errors  were  diagnosed  to  be: 

a.  the  overdevelopment  of  lows  in  the  principal  cyclone  track 
across  the  northern  Pacific. 

COMMENT:  There  is  no  corresponding  negative  bias  in  the  northern 

Atlantic,  suggesting  that  with  but  a  few  additional  upper-air  soundings 
the  initialization  problem  is  minimized.  Work  is  in  progress  to  improve 
the  surface  stress  terms;  specifically  to  make  the  drag  coefficient  a 
function  of  the  wind  speed.  Moreover,  we  plan  to  specify  the  initial 
divergent  wind  component  within  a  matter  of  weeks. 

b.  the  overdevelopment  of  continental  highs,  especially  over 
Asia . 
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COMMENT:  The  model  does  not  contain  terms  representing  the  heat 
storage  of  the  land  surfaces.  This  is  important  in  the  autumn  when  the 
relative  warm  surface  modifies  the  lower  part  of  the  southward-moving 
cold  highs  significantly.  Additionally,  the  model  does  not  contain  the 
initial  specification  of  the  divergent  wind  component.  Further,  both 
the  analysis  and  prediction  models  contain  insufficient  vertical  resolu¬ 
tion  to  pose  the  temperature  structure  properly.  Low-level  inversions 
are  not  present.  Consequently,  it  is  difficult  to  model  the  sensible 
heat  exchange  with  sufficient  realism.  In  connection  with  the  latter, 
note  the  tendency  to  move  the  Asian  high  eastward  across  China  to  Japan. 

c.  under-movement  of  pressure  systems. 

COMMENT:  This  model,  like  all  other  numerical  models,  has  a  tendency 
to  under-translate  small-scale  pressure  systems.  This  is  the  classical 
truncation  error  that  is  related  to  200  nautical  mile  mesh  length  and  the 
approximations  which  are  implicit  in  the  finite-difference  operators. 

The  smaller  the  horizontal  scale  of  the  system,  the  more  difficult  the 
problem  becomes.  In  contrast,  we  have  observed  that  the  large-scale 
(SL)  disturbance  predictions  contain  considerable  skill  through  72  hours. 

3 .  Interim  Measures 

Until  notified  that  particular  modifications  have  been  implemented, 
it  seems  advisable  for  users  to  make  local  compensatory  corrections 
based  on  the  following  information: 
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a.  As  a  first  approximation,  most  migratory  continental 


systems  and  oceanic  lows  are  under-translated  by  about 
15  percent  of  the  forecast  displacement, 
b'.  Cold  lows  over  oceans  are  usually  too  deep  by  3  to  5  millibars 
in  24  hours  and  5  to  8  millibars  in  48  hours,  with  little 
further  bias  beyond  48  hours. 

c.  Cold,  continental  highs  are  too  strong  by  about  2  to  5  milli¬ 
bars  in  24  hours  and  4  to  8  millibars  in  48  hours,  depending 
on  such  factors  as 

(1)  Surface-air  temperature  difference  (bigger  bias  for 
larger  differences) . 

(2)  Horizontal  scale  of  system  (bigger  bias  for  smaller 
scales) . 

(3)  Rate  at  which  the  high  is  changing  latitude  (bigger  bias 
for  faster  meridional  motion) . 

4 .  Summary  of  500  MB  Prognoses 

Table  2  and  Figure  2  summarize  the  comparative  verification 
results  for  the  PE  and  BARO  500  MB  prognoses  for  November.  Since 
the  number  of  observations  at  500  MB  is  only  one-eighth  of  the  number 
in  a  typical  surface  pressure  analysis,  the  scores  contain  more 
uncertainty.  (The  best  guess  as  to  the  RMSE  of  the  initial  and  verifi¬ 
cation  analyses  is  about  20  meters.) 
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The  BARO  12-hour  progs  were  slightly  better  than  the  12-hour 
PE  progs,  but  the  PE  becomes  and  remains  better  than  the  BARO  by 
18-24  hours.  It  should  be  noted  that  the  500  MB  analyses  are  still 
biased  in  favor  of  the  BARO  since  the  12-hour  BARO  progs  are  used  to 
first  guess  the  analyses.  Yet,  by  72  hours,  the  PE  has  about  twice 
the  skill  of  the  BARO  when  compared  to  persistence. 

5 .  Mean  Errors  in  PE  500  MB  Progs 

Since  the  PE  Model  forecast  surface  pressure  changes  are 
obtained  as  an  algebraic  sum  of  the  predicted  flux  divergences  for 
the  five  layers  in  the  model  (from  the  continuity  equation) ,  the  mean 
error  patterns  at  sea  level  are  highly  correlated  to  the  mean  errors  at 
500  MBs.  But,  a  proper  error  diagnosis  for  tropospheric  height/ 
temperature  forecasts  is  much  more  complex  than  at  sea  level.  For 
example,  we  integrate  on  sigma  surfaces  (which  tend  to  be  quasi¬ 
parallel  to  the  underlying  terrain  at  low  elevations,  but  become  quasi¬ 
horizontal  with  increasing  height).  The  model  knows  the  heights/ 
temperatures  on  these  surfaces  only.  At  output  time,  interpolation/ 
extrapolation  procedures  are  used  to  get  values  on  pressure  surfaces. 
We  assume  that  the  temperatures/heights  are  linear-in-log  P  between 
sigma  surfaces.  Thus,  it  is  possible  to  have  an  outstanding  prog  on 
sigma  coordinates  and  generate  errors  from  the  foregoing  procedures/ 
assumptions . 
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Intensive  work  is  currently  in  progress  to  alleviate  these  diffi¬ 


culties.  The  solution,  of  course,  is  to  have  increased  vertical 
resolution  in  both  the  analysis  and  prediction  models. 

COMMENT.  Question:  What  is  the  proper  use  of  height  progs?  Until 
recently,  the  heights  were  used  for 

a  .  computing  geostrophic  winds 

b.  qualitative  interpretation  to  determine  the  evolutions  of 
pressure  systems 

c.  computing  the  implied  corresponding  surface  pressure 
changes  (BARO-SLP  Model) . 

The  PE  Model,  on  the  other  hand,  completely  eliminates  all 
three  of  the  traditional  uses  of  height  progs.  Independent  winds  which 
are  in  proper  balance  with  the  mass  fields  are  available  from  the  model. 
These  winds  are  weaker  in  troughs  and  stronger  in  ridges  than  geo¬ 
strophic  winds.  Overplots  of  these  winds  on  height  fields  showthat 
cross-contour  flow  is  present  in  about  the  regions  where  acceleration/ 
deceleration  should  be  occurring.  Finally,  the  PE  surface  progs 
represent  our  best  guess  as  to  the  evolutions  of  pressure  systems. 

This  relieves  the  field  specialist  of  most  of  the  prediction  decisions. 

He  can  now  concentrate  on  such  things  as  interpretation  and  judgment, 
critical  evaluation,  prog  modification  and  feedback. 

Figures  5  and  6  contain  the  500  MB  Mean  Error  Patterns  for  the 
24-hour  and  49-hour  PE  progs,  respectively. 
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VERIFICATION  RESULTS  OF  NOVEMBER  1970  SURFACE  PROGNOSES 
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NOTE.  RMSE  scores  are  computed  for  all  grid  points  north  of  20°  North.  The  inclusion  of  tropical 
points  would  make  these  figures  considerably  smaller. 


VERIFICATION  RESULTS  OF  NOVEMBER  1970  500  MB  PROGNOSES 
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NOTE.  RMSE  scores  are  computed  for  all  grid  points  north  of  20°  North.  The  inclusion  of  tropical 
points  would  make  these  figures  considerably  smaller. 


TABLE  3 


VERIFICATION  RESULTS  OF  NOVEMBER  1970  36-HOUR  PE  MODEL 

SURFACE  PROGNOSES 

AREA  RMSE  (millibars) 


NORTHERN  HEMISPHERE  4.2 

(EQUATOR  TO  POLE) 

LAND  POINTS  5 . 1 

SEA  POINTS  3 . 5 

LAND  REGIONS; 

Americas  5.8 

As  ia  5.7 

Near  East  2 , 1 

Europe  5.0 

OCEAN  REGIONS; 

Atlantic  3 . 6 

Pacific  3.5 

Indian  1 . 6 

Mediterranean  3.3. 
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NORTHERN  HEMISPHERE  RMSE  (in  millibars) 


SEA  LEVEL  PRESSURE  PROGNOSES  VERIFICATION  RESULTS 


NOVEMBER  1970 


Figure  1.  Summary  of  Verification  Scores  (RMSE)  for  all  forecasts  made 
in  the  month  of  November  1970  by  the  Primitive  Equation  Model  (PE), 
the  Sea  Level  Pressure  Model  (SLP) ,  and  Persistence  (P) .  Every  PE  prog 
showed  skill  over  persistence  to  72  hours. 
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RMSE  (meters) 


500  MB  HEIGHT  PROGNOSES  VERIFICATION  RESULTS 
NOVEMBER  1970 


0  12  24  36  4*8  ^0  'll 

FORECAST  PERIOD  (Hours) 


Figure  2.  Summary  of  Verification  Scores  (RMSE)  for  all  forecasts  made  in 
the  month  of  November  1970  for  the  Primitive  Equation  Model  (PE),  the 
Barotropic  Model  (BARO),  and  Persistence  (P) . 
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Figure  3.  November  1970  24~HR  PE 
Surface  Prog  Mean  Error  Pattern 

(in  millibars) 


Figure  5.  November  1970  24~HR  PE 
j  500  MB  Prog  Mean  Error  Pattern 
(in  meters) 


